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A method for generating and coding graphic images for 
transmission to hand-held or mobile devices uses an object- 
component technique wherein images are composed from a 
limited set of component types, particularly points and 
polygons. Images are encoded as a list of objects to be 
drawn, with each object specified by a command word (FIG. 
3) followed by one or more coordinate words (FIG. 4) 
locating that object in a fixed coordinate image field. The 
command word indicates the object outline colour (c), the 
type of object (CC), and whether it is selectable (s) by a user 
for interactive applications. Parameter bits (p) in the com- 
mand word indicate point radii or the number of polygon 
vertices. With a particular type (CC) setting, text strings may 
be included in the image. 
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GRAPHIC IMAGE GENERATION AND 
CODING 

FIELD OF THE INVENTION 

The present invention relates to the formation, manipu- 5 
lation and coding of graphic images and particularly, but not 
exclusively, to the coding of graphic objects for transmission 
to, and/or reception from, hand-held or mobile devices of 
one or more remote users. 

10 

BACKGROUND OF THE INVENTION 

The majority of the current generation of hand-held 
mobile devices are driven by text-based user interfaces. 
Through these interfaces, the user is enabled to browse the is 
handsets range of functionality and select and perform the 
required tasks. Such mobile devices can also exchange 
information using protocols such as the Short Message 
Service (SMS) part of the Global System for Mobile com- 
munications (GSM) digital standard. These text based dis- 20 
plays have a limited capability and lack the flexibility of 
display and appeal of graphical information. Increasingly 
there is a desire to incorporate graphical information to 
improve both the user interface and the exchange of infor- 
mation. 25 

An example of a mobile messaging system seeking to 
improve the ready understandability of messages through 
the use of displayed graphic icons to represent or support a 
message is described in International patent application 
W097/19429 (Motorola/Deluca et al). In the mobile tele- 30 
phone receiver described, a graphics database holds image 
data for a number of predetermined images, each identified 
by a respective (and standardised) code. On receipt of a 
paging message from another user, the handset processor 
scans the message firstly to identify whether it contains the 35 
code or codes for one or two of the images stored in the 
graphics database and, on finding these, it generates these 
images on a display screen of the handset. Secondly, it scans 
the message for any character string data which, if found, 
will be converted to a text message and displayed on screen 40 
below the image or images. 

Whilst this arrangement can add to the appeal and under- 
standability of the paging message, its flexibility is limited 
by the need for the image data to be pre-loaded to the 
handset although various techniques are described for updat- 45 
ing the handset's graphic database, from manual data entry 
through to over-the-air downloading of graphics data files, 
the problem remains that the identity of each of this finite set 
of images must be standardised — at the very least between 
pairs of users who intend to utilise the service. 50 

SUMMARY OF THE INVENTION 

It is, therefore, an object of the present invention to 
provide an extremely compact generation and coding tech- 55 
nique for images to be displayed on the screens of hand-held 
or mobile apparatus, which data may be sent as the whole or 
part of a message. 

It is a further object to provide a communications appa- 
ratus configured to receive, decode and display such coded 60 
images. 

In accordance with a first aspect of the present invention 
there is provided a method for generating and coding for 
transmission a graphic image, comprising the steps of: 
composing the image from a plurality of component objects 65 
from a predetermined set of object types, the composition 
including scaling and locating of each object within a fixed 
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coordinate set image field; generating an ordered rendering 
list identifying the order in which the component objects are 
to be rendered on regeneration of the image; sequentially 
coding each object of the list as a first data word identifying 
the object type and one or more further words specifying 
coordinates for said object. By specifying the image in the 
form of an overlaid arrangement of objects (which may 
include points, polygons and text strings) the sender has 
great flexibility in the form of image that may be sent. Also, 
by the restriction to a finite set of object types, the amount 
of data required to transmit the image is kept very low. 

In order to permit a certain amount of interactivity, 
receivers of the images may be enabled to select one or more 
of the objects making up the image, to which end the first 
data word may include an indicator as to whether that object 
is selectable from among those of the complete image by a 
receiver of the image. The first data word may also include 
an indicator as to whether the respective object is to be 
reproduced as outline or to be filled in: where the object is 
a polygon, following the first data word, the following 
further words may suitably specify in sequence coordinates 
within the image field of each vertex of said polygon, such 
that irregular and relatively complex polygonal shapes may 
be specified. 

The fixed coordinate set image field (suitably 128 pixels 
square) enables all object coordinates to be specified relative 
to one another without requiring knowledge of the size or 
resolution of the target device display screen. 

Also in accordance with the present invention there is 
provided a portable communications apparatus configured to 
receive and decode graphics images generated and coded in 
accordance with the method outlined above, the apparatus 
comprising: a display device coupled with a display driver 
circuit arranged to format images for display; a receiver 
coupled with said display driver and being configured to 
receive the coded image data and pass it to the display 
driver; and first storage means coupled with said display 
driver and containing said object identifier codes, said 
display driver being configured to reconstruct the image 
from the object data and output the same to the display. 

Where the display differs in height and/or width compared 
to the image field, the apparatus may further comprise 
multiplication means coupled with the display driver and 
arranged to scale the image object coordinates to the size of 
the display. 

Suitably, the apparatus may further comprise input means 
by operation of which a user may select one or more of those 
displayed objects identified in the code stream by its first 
data word as selectable, which input-means is suitably 
coupled with message formatting and transmission means 
configured to generate a signal identifying the selected 
object and transmit the same to the image originating source. 
These input means may comprise a touch screen overlaying 
the display or, where the apparatus further comprises a 
plurality of user operable controls (for example numerical 
keys of a portable telephone) the input means may be 
provided as selectable secondary functions of these user 
operable controls. 

Thus the method provides a means for describing graphi- 
cal images for display in terms of objects, in a format 
optimised for low bit-rate mobile data communications. The 
method allows objects to be displayed in a device indepen- 
dent manner on low to medium resolution graphical displays 
such as those of mobile telephones or PDA's. Additionally, 
in some embodiments, the scheme enables users to select 
objects using a variety of methods, for example touch 
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screens or via a cursor selection. Information regarding 
which object is selected may be communicated back to the 
originator thereby enabling use in, for example, navigation 
and interactive displays. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Preferred embodiments of the present invention will now 
be described by way of example only and with reference to 
the accompanying drawings in which: 

FIG. 1 is an example component object image formed 
from seven objects; 

FIG. 2 is a table of the respective properties of each of the 
objects in the image of FIG. 1; 

FIG. 3 represents the bit -structure of a command word 
identifying an object; 

FIG. 4 represents the bit-structure of an object coordinate 
specification; 

FIG. 5 is a table of object type-bit values from the 
command word of FIG. 3 and their respective meanings; 

FIG. 6 is a table detailing the sequential coding of each of 
the objects in the image of FIG. 1; and 

FIG. 7 is a block schematic diagram of a receiver appa- 
ratus suitable to embody the present invention. 

DETAILED DESCRIPTION OF THE 
INVENTION 

In order to permit the direct transmission of graphic 
images to hand-held or mobile devices, a component object 
specification is used which describes an image by the objects 
comprising it (lines, polygons, points/circles etc.). The 
applicants have recognised that describing an image this 
way is a valuable technique for such devices due to the 
favourable trade-off between the generally small overall size 
of the encoded image, and the consequently reduced level of 
processing required in the display device. The principal 
advantage of sending images in component object form is 
the size of the encoded image. For simple line drawings, the 
low-redundancy nature of the encoding can result in con- 
siderable savings over a bitmap-based encoding. A useful 
additional feature is that the image can be easily scaled to an 
arbitrary size at the point of display, allowing the image sent 
to be displayed consistently regardless of the display device. 

Because the image is based on objects with a clear 
relationship between the encoded object and the visual 
object (e.g. one object may be the outline of a house), it is 
possible to attach additional information to objects — for 
example, whether or not the object can be "selected" by the 
user, say, by pointing at it with a cursor or via a touch- 
screen — in a logical manner. With regard to the processing 
required to display the image, since the data is sent as series 
of vectors, algorithms for drawing lines and filling areas of 
the display must be implemented in the display device. 
However, as will be understood, such algorithms are well- 
known and can be efficiently implemented. 

Component object images as used in the following 
examples are comprised of three main drawing objects: 
points, text, and polygons; a polygon may have between one 
and nine edges and, assuming a monochrome or two-colour 
display, may be filled or unfilled. Each object can be drawn 
in either "black" (with pixels set) or white (pixels are 
cleared). FIG. 1 shows an example component object image 
10 constructed from a total of seven objects 11-17, Note that 
it is possible to overlay objects on top of each other; objects 
are drawn in the order in which they are specified in the 
encoded data stream (as will be described below) and the 
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encoded data therefore represents an ordered list of display 
objects. This implicit information (i.e. the number of the 
object in the list) does not need to be communicated explic- 
itly but may be used to return information to the originator 

5 of the image (for example the number of an object which the 
user has selected). 

As an example, the properties of each object in the 
example image of FIG. 1 are as shown in the table of FIG. 
2. Because object 14 (a white filled polygon) was drawn 

10 after object 13 (black filled polygon) it appears on top of the 
arrow-shaped polygon 13. Likewise the text string (object 
15) appears on top of the white filled polygon 14. 

All vertices in component object images are specified in 
a fixed coordinate image field using the XY coordinate 

15 system shown in FIG. 1, with the origin in the top left hand 
corner and a range 0-127 for each axis. Although the image 
field is "square" (the ranges for the X and Y axes are the 
same), the display device is unlikely to be. The image will 
be scaled in the terminal to fit the display. 

20 Although the exact display resolution of the display is not 
necessarily known when an image is being drawn, it is 
suggested that images are designed to be drawn with an 
aspect ratio consistent with the display device, where 
known: the aspect ratio is the ratio of width to height such 
that a display 160 pixels wide and 64 pixels high would have 
an aspect ratio of 2.5 and the source images should be scaled 
accordingly. Alternatively, the operator could specify in a 
header to the message containing a component object image 
the intended display resolution and arrange for the terminal 
to scale the data accordingly. 

The encoding of component object data is intended to be 
particularly compact: every object to be drawn is sent a 
command word followed by a variable length of data. The 

35 data may be characters (7-bit ASCII) or coordinates (14- 
bits). It is assumed in this example that the receiver/decoder 
knows in advance the length of the component object data, 
and therefore there is no explicit termination; a number of 
mechanisms may be used to communicate this to the display 

40 terminal as will be well understood — for example it may 
form part of the SMS packet header, if a GSM mobile 
telephone was the receiving device. 

The commands are formatted as 7-bit words of data. The 
overall bit format is as shown in FIG. 3, with all data being 

45 encoded in the order of most-significant to least significant 
bit. The first bit, c, is the colour bit and indicates whether the 
object perimeter line is to be drawn in the background colour 
("white"; c=0) or the foreground colour ("black"; c=l). The 
next two bits, CC, indicate the type of object (point, text, 

50 filled or unfilled polygon), following which is one bit, s, 
indicating whether or not object may be selected at the 
device of a receiving user (0=no; l=*yes), then three bits, 
ppp, to specify a parameter value of 0-7. The meaning of the 
three parameter bits, ppp, depends on the object type CC 

5 5 selected (described below). 

Commands may be followed by coordinates in terms of 
the image field and formatted as shown in FIG. 4, with the 
first seven bits giving a value 0-127 for the X coordinate, 
and the other seven bits giving a value 0-127 for the Y 

60 coordinate. 

Every command word effectively creates a new display 
object. In addition to the information required to actually 
render the object, described below, each object has a "select- 
able" attribute, indicating to the display terminal by the 

65 setting of the s bit in the command word whether or not an 
object may be selected by the user. For example, an image 
representing the United States political map may make each 
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state boundary (coded as a polygon object) a selectable 40 which may comprise a simple hardware arrangement of 

object; this would allow a user to graphically select a state multipliers to convert the image field coordinates in the 

by some means in order to, say, request further (location received data stream to fit the available area and aspect ratio 

specific) information. of the display device 28. Finally, output signals from the 

A number of methods by which the user may select 5 processor 26 such as speech i messages, indications of object 

objects will be apparent to the reader and will depend upon * lecUons > or new ff* f**c images generated on the device 

*ul „ n - n uT.'„, I* '.u* a- i • i kt * u fu * (by user operation or the controls 32) are sent via encoder 42 

toe capabilmes of the display terminal. No e. however, that ^ the transceiver 22 for sending, 

by attaching the notion of selectabihty to the object rather A .... . , & . . 4 , 

than to a physical area of the display, it is possible with M ^ b * "fS?^ ' are possible on the 

, . \S „ , • . ■ j * * , . m arrangement of FIG. 7. For example, the command word 

devices with no actual pointing device to still select » ^ l ore 3g m be to at ^ P w - tn ^ al device 

objects-for examp e, a mobile telephone may use the memory 30 . Also, the decoder 24/encoder 42 and/or scaling 

up/down keys to cycle a cursor through each of the selected • - 4 J An A t • . . , , t , . fi & 

r. , J 3 . i . i_i L - . . . ... i circuit 40 functions may be embodied completely in soft- 
objects, or cause each selectable object in turn to blink on « - j * * « ; , , 

\ . „ J . e , , ware and earned out in processor 26. Alternatively or 

and off (by periodically toggling the value of the colour bit . r4 . „ t , «. , , C - f 4 . ' 

x •/ y l , ■ j 7 1C additionally, the display driver functions of the processor 

c), prior to pressmg another key to indicate selection. 15 moi , . u «~ai a u * \ n *u a- i 

" r f & j mav ^ handled by a separate unit, optionally with a display 

Hie two C bits of the command word indicate the type of memory from which display data would be read out. 

object to be drawn. This also determines the meanmg of the Touch-screens 34 are highly suited to graphical displays, 

parameter bits ppp of the command word. The table of FIG. n ide QOt onl a method for object selectioQ bm ^ 

5 shows the possible settings and I their meanings Note that for object Such an ^ t mechanism muplBA ^ 

a point command (CC-00) specifies a filled circle having a the enoodin raechanism would ^ oy/ hical information 

radius of from 1 to 8 pixels (ppp-000 to ppp-111) centred t0 be packed ^ a message that ^ be ^ and decoded 

on the point identified by the single following coordinate at the receiver t0 enable graphics t0 be exchange d between 

word. Also, the single coordinate word following the three mobile devices 

parameter bits of a text command (CC-01) specifies the Awide variety ofappUcation areas are possible including: 

ocation of th ;top left part of the ^first character of he aext usef ^ ^ J% ^ ^ eaauw J a 

(assuming a fixed text size in the display device). With • i- „ • \- . iU ■ r 

v a t *u a' * -a r ii • i using server chp-art, car map navigation, traffic information, 

regard to the coordinate words following a polygon com- „ „Z~i- u« ♦ r ■ ♦ - i a- u a 

~~~a/w m n\ -f.u i * * * c en a i j a whole host of interactive games including chess and 

mand (CC-10 or 11), ,f the last point of a filled polygon does d hts etc A toudMcn)en Jir interface using the encod- 

no match the first point the polygon is impUci. y closed by m * chni aUows ^ ^ whUe ^ 

a straight line from the las point o the first. With regard to ^ ^ encodes drawin P 

a polygon command, it will be noted that the parameter bits ^ u j u n • 

r/e> liL , r . * t , mechanism, messages may be personalised by allowing 

ppp represent the number of vertices minus two: ttiis rec- drawin and handwritten ^ , 0 b ^ incoiporated m message t 

ogmses mat tne simplest polygon tnat may validly be exchan ged between mobile appliances. The ability to indi- 

specified has two vertices (i.e. it is a line, as object 11 in FIG. m « 1 * u- ♦ ui 1 u * . * t_ 

^ . - u ui *u # u j j i i- i_ ji 35 vidually select objects enables complex hotspots to be 

1) which enables the range to be shifted and thereby handle Aa ^ A „~a ™ i -a # *u ** *u u *u 

the specification of polygons of up to nine vertices fjjf and ° Verkld at the Same tUDe 115 the shapeS lhem - 

_ By way of a detailed example the table of FIG. 6 shows the f ^ ^ be ^ tfaat we haye ovided 

mecomponentobjectencc^ingoftheexampk a mechanism whereb objects be coded in ^ format 

m FIG. 1; from this it can be seen hat the entire image can 4Q timised for low bit . rate mobile data communicatio ns. Hie 

be expressed in 448 bits, or 56 bytes, of data. coding scheme aUows objects to be mapped (o 

A block schematic diagram of a mobile/hand-held screen coordinates enabling the images to be rendered in a 

receiver configured to receive and handle the component device-independent manner. Additionally, since the objects 

object encoded messages is shown m FIG. 7. The function- are given a separate identity in the coding scheme, they may 

ing of many of the component parts will be well understood 45 a iso be separately highlighted and selected on the screen, 

by the skilled reader and, other than in terms of their bearing Information regarding which object is selected may be 

on the operation of the present invention, they will not be communicated back to the originator enabling navigation 

described in detail. and interactive displays. 

From an aerial 20 or other signal input, the received signal From reading the present disclosure, other modifications 

is passed via transceiver 22 and decoder 24 stages to a 50 will be apparent to persons skilled in the art. Such modifi- 

central processing unit 26, which unit also (in this cations may involve other features which are already known 

embodiment) handles the function of display driver format- m the design, manufacture and use of interactive image 

ting graphical and text data into display commands for co ding equipment and component parts thereof and which 

output to display screen 28. An apparatus memory 30 is ma y be used instead of or in addition to features already 

coupled with the processor and holds basic operating data 55 described herein. Although claims have been formulated in 

and programs for the device. User input to the processor 26 this application to particular combinations of features, it 

is via controls 32: these may be in the form of a simple should be understood that the scope of the disclosure of the 

keypad and/or they may be combined with the display 28 present invention also includes any novel feature or any 

through a touch-screen arrangement, as indicated by dashed novel combination of features disclosed herein either explic- 

line 34. Other conventional functions of the device (for 60 itly or implicitly or any generalisation thereof, whether or 

example audio handling) are illustrated generally at 36. not it relates to the same invention as presently claimed in 

Coupled with the processor 26 is a further store 38 any claim and whether or not it mitigates any or all of the 

containing the command word codes (see FIGS. 3 and 5) to same technical problems as does the present invention. The 

enable the processor/display driver 26 to interpret received applicants hereby give notice that new claims may be 

command words and recreate the encoded image: this 65 formulated to such features and/or combinations of features 

memory may also hold the table of ASCII codes for text during the prosecution of the present application or of any 

strings. Also coupled with the processor 26 is a scaling stage further application derived therefrom. 
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What is claimed is: 

1. A method for generating and coding for transmission a 
graphic image, comprising the steps of: 

composing the image from a plurality of component 
objects from a predetermined set of object types, the 5 
composition including scaling and locating of each 
object within a fixed coordinate set image field; 

generating an ordered rendering list identifying the order 
in which the component objects are to be rendered on 
regeneration of the image; and 10 

sequentially coding each object of the list as a first data 
word identifying the object type and one or more 
further words specifying coordinates for said object, 
said first data word further including parameters, said 
parameters being a number of vertices minus two when J5 
said object type is a polygon. 

2. A method as claimed in claim 1, wherein said first data 
word includes an indicator as to whether that object is 
selectable from among those of the complete image by a 
receiver of said image. 

3. A method as claimed in claim 1, where the object is a 20 
polygon and, following the first data word, said further 
words specify in sequence coordinates within image field of 
each vertex of said polygon. 

4. A method as claimed in claim 1, where the fixed 
coordinate set image field is 128 pixels square. 25 

5. A portable communication apparatus configured to 
receive and decode graphics images generated and coded in 
accordance with a method comprising the steps of: 

composing the image from a plurality of component 
objects from a predetermined set of object types, the 30 
composition including scaling and locating of each 
object within a fixed coordinate set image field; 
generating an ordered rendering list identifying the order 
in which the component objects are to be rendered on 
regeneration of the image; and 35 
sequentially coding each object of the list as a first data 
word identifying the object type and one or more 
further words specifying coordinates for said object, 
said first data word further including parameters, said 
parameters being a number of vertices minus two when 40 
said object type is a polygon; 
the portable communication apparatus comprising: 
a display device coupled with a display driver circuit 

arranged to format images for display; 
a receiver coupled with said display driver and being 45 

configured to receive coded image data and pass the 

coded image data to the display driver; 
first storage means coupled with said display driver and 

containing object identifier codes, said display driver 

being configured to reconstruct the image from the 50 

object identifier codes and output the image to the 

display. 

6. Apparatus as claimed in claim 5, further comprising 
multiplication means coupled with said display driver and 
arranged to scale the image object coordinates to the size of 55 
the display. 
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7. Apparatus as claimed in claim 5, wherein said input 
means comprises a touch screen overlaying said display. 

8. Apparatus as claimed in claim 5, further comprising a 
plurality of user operable controls wherein said input means 
are provided as selectable secondary functions of said user 
operable controls. 

9. A device for generating and coding to transmit an 
image, comprising: 

means for composing the image from a plurality of 
component objects from a predetermined set of object 
types, including scaling and locating of each object 
within a fixed coordinate set image field; 

means for generating an ordered rendering list identifying 
order in which the component objects are to be ren- 
dered on regeneration of the image; and 

means for sequentially coding each object of the list as a 
first data word identifying the object type and one or 
more further words specifying coordinates for said 
object, wherein said first data word includes 
parameters, said parameters being a number of vertices 
minus two when said object type is a polygon. 

10. The device of claim 9, wherein said first data word 
includes an indicator as to whether said object is selectable 
from among said objects of the image by a receiver of said 
image. 

11. The device of claim 9, wherein said object is a 
polygon and, following the first data word, said further 
words specify in sequence coordinates within image field of 
each vertex of said polygon. 

12. The device of claim 9, wherein said fixed coordinate 
set image field is 128 pixels square. 

13. A method as claimed in claim 1, wherein said first data 
word includes an indicator as to whether that object is to be 
reproduced as outline or to be filled in. 

14. A portable communication apparatus as claimed in 
claim 5, further comprising input means by operation of 
which a user may select one or more of those displayed 
objects identified in the code stream by its first data word as 
selectable, the apparatus including message formatting and 
transmission means configured to generate a signal identi- 
fying the selected object and transmit the same to the image 
originating source. 

15. The method of claim 1, wherein said coordinates are 
relative to other coordinates of other objects. 

16. The portable communication apparatus of claim 5, 
wherein said coordinates are relative to other coordinates of 
other objects. 

17. The device of claim 9, wherein said coordinates are 
relative to other coordinates of other objects. 

18. The device of claim 9, wherein said first data word 
further includes an indicator as to whether said object is to 
be reproduced as outline or to be filled in. 

• * * * * 
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